Journal of Positive Behavior Interventions 

http://pbi.sagepub.com/ 


Classroom-Level Positive Behavior Supports in Schools Implementing SW-PBIS : Identifying Areas for 

Enhancement 

Wendy M. Reinke, Keith C. Herman and Melissa Stormont 
Journal of Positive Behavior Interventions 2013 15: 39 originally published online 25 September 2012 

DOI: 10.1177/1098300712459079 

The online version of this article can be found at: 
http://pbi.sagepub.eom/content/15/1/39 


Published by: 

Hammill Institute on Disabilities 


HAMMILL 

INSTITUTE 

ON DISABILITIES 


and 

®SAGE 

http://www.sagepublications.com 


Additional services and information for Journal of Positive Behavior Interventions can be found at: 

Email Alerts: http://pbi.sagepub.com/cgi/alerts 
Subscriptions: http://pbi.sagepub.com/subscriptions 
Reprints: http://www.sagepub.com/journalsReprints.nav 
Permissions: http://www.sagepub.com/journalsPermissions.nav 



» Version of Record - Dec 10, 2012 
OnlineFirst Version of Record - Sep 25, 2012 
What is This? 


Downloaded from pbi.sagepub.com at University of Missouri-Columbia on January 29, 2013 



JJHAMMILL INSTITUTE 

I on Disabilities 


Cl ass room -Level Positive 
Behavior Supports in Schools 
Implementing SW-PBIS: 
Identifying Areas for Enhancement 


Journal of Positive Behavior Interventions 
15(1) 39-50 

©2013 Hammill Institute on Disabilities 
Reprints and permission: 
sagepub.com/journalsPermissions.nav 
DOI: 1 0.1 177/1098300712459079 
http://jpbi.sagepub.com 

®SAGE 


Wendy M. Reinke, PhD 1 , Keith C. Herman, PhD 1 , and Melissa Stormont, PhD 1 


Abstract 

This study evaluated the use of classroom-level behavior management strategies that align with School-Wide Positive 
Behavioral Interventions and Supports (SW-PBIS). Direct observations of universal classroom management strategies were 
conducted across 33 elementary classrooms in elementary schools implementing SW-PBIS with high fidelity. Findings 
indicate that classrooms had posted positively stated classroom rules at high rates, whereas teacher use of specific praise 
and the ratio of positive to negative interactions were less than optimal. Furthermore, classroom teachers with higher rates 
of general praise were found to report being more efficacious with regard to classroom management. In turn, teachers in 
classrooms with higher rates of disruptive behavior reported feeling less efficacious. In addition, teachers with lower rates 
of positive to negative interaction, who used higher rates of harsh reprimands and had higher rates of disruptions, reported 
higher levels of emotional exhaustion. Implications for developing supports to assist teachers struggling with universal 
classroom management strategies are described. 
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Over the past decade, there has been an increasing trend for 
schools to implement school- wide discipline systems. 
Nearly 14,000 schools across the United States currently 
implement School-Wide Positive Behavioral Interventions 
and Supports (SW-PBIS; see www.pbis.org). The recent 
shift toward the use of universal systems to support proso- 
cial student behaviors and decrease disruptive behaviors 
among students has been effective. Research has shown the 
impact of SW-PBIS in reducing problem behavior and 
increasing academic performance (Bradshaw, Mitchell, & 
Leaf, 2010; Homer et al., 2009). 

Despite the increased implementation of SW-PBIS or 
other universal school-level behavior support systems, many 
teachers continue to struggle with managing student behav- 
ior in the classroom (Buell, Hallam, Gamel-McCormick, & 
Scheer, 1999; Pavri, 2004). For instance, teachers indicate 
that they consider classroom management to be the most 
challenging aspect of their job and one in which they receive 
the least amount of training (Barrett & Davis, 1993; Ingersoll, 
2002; Reinke, Stormont, Herman, Puri, & Goel, 2011). 
School-wide prevention-based systems will not be as effec- 
tive in supporting positive outcomes for students if ineffec- 
tive management practices are present at the classroom level. 


Ineffective classroom behavior management practices are 
associated with negative outcomes for students and teachers 
alike. Research indicates that students in classrooms where 
behavior is poorly managed receive less academic instruc- 
tion (Weinstein, 2007) and are more likely to have long-term 
negative academic, behavioral, and social outcomes than stu- 
dents in well-managed classrooms (Ialongo, Poduska, 
Werthamer, & Kellam, 2001; Kellam, Ling, Merisca, Brown, 
& Ialongo, 1998; National Research Council, 2002). 
Furthermore, teachers find student discipline problems to be a 
leading source of stress (Supapom, Dodds, & Griffin, 2003) 
and a contributor to teacher burnout (Kokkinos, Panayiotou, 
& Davazoglou, 2005). Furthermore, a recent study found 
that teachers who experienced higher levels of classroom 
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stress from student misbehavior reported lower levels of 
self-efficacy in classroom management (Klassen & Chiu, 
2010). Thus, lack of efficacy, or perceived inability to man- 
age classroom behavior, may contribute to teacher attrition 
from the field. Nearly half of new teachers leave the profes- 
sion within 5 years, many citing student misbehavior as a 
primary reason for leaving (Ingersoll, 2002). 

Teachers’ Self-Efficacy 

General education teachers are expected to effectively man- 
age classroom behaviors with varying levels of support for 
implementation while maintaining high levels of academic 
instruction. It is important to understand teacher character- 
istics that are associated with greater implementation of 
effective classroom management. Teacher self-efficacy in 
classroom management is an important area for future 
research, especially within the context of broader systems 
change efforts. Bandura (1977, 1982, 1989) suggested that 
self-efficacy is the mediating variable between knowledge 
and actual behavior. Thus, teachers who do not feel effica- 
cious in their classroom management skills may be less 
likely to utilize effective strategies. Teachers’ sense of effi- 
cacy has been found to be related to instructional practices 
(Allinder, 1994), proactive and positive classroom manage- 
ment (Woolfolk, 2007), and student achievement and moti- 
vation (Caprara, Barbaranelli, Steca, & Malone, 2006). 
Furthermore, teachers’ beliefs about their efficacy have been 
identified as a factor that strongly influences their imple- 
mentation of new interventions (Guskey, 1988; Flan & 
Weiss, 2005; Stein & Wang, 1988). Teachers who feel more 
confident in their use of effective classroom management 
may indeed be implementing more effective practices (Flan 
& Weiss, 2005). Therefore, information about teacher effi- 
cacy may help to identify teachers in need of coaching or 
additional training. Specifically, teachers who report low 
efficacy can be identified for more support, especially if 
low efficacy is associated with specific negative practices. 

Teacher Burnout 

Another important construct related to teacher implementa- 
tion of classroom practices is professional burnout. Teacher 
burnout has been linked to teacher turnover intentions and 
job absenteeism (Belcastro & Gold, 1983), as well- 
diminished performance and irritability (Fluberman, 1993). 
This construct contains three components that are related to 
implementation of classroom practices, including emo- 
tional exhaustion, depersonalization, and sense of personal 
accomplishments from the job (Maslach, Jackson, & Leiter, 
1996). In particular, teacher report of emotional exhaustion, 
defined as the “tired and fatigued feelings that develop as 
emotional energies are drained” (Maslach et ah, 1996, p. 28), 
is likely to interfere with a teacher’s efforts to implement 


effective instructional practices, and may influence the 
development of negative attitudes toward students, which 
can result in increased negative interactions with students 
(Lamude, Scudder, & Fumo-Lamude, 1992). If emotional 
exhaustion can be readily assessed and is comiected to low 
levels of teachers’ use of effective classroom behavior man- 
agement practices, teachers reporting high levels could be 
targeted for additional supports. 

Research on classroom-level practices, teacher efficacy, 
and emotional exhaustion are important areas for explora- 
tion within schools implementing SW-PBIS. The majority 
of research on SW-PBIS has been at the school-wide level, 
and more research is needed to understand classroom-level 
characteristics associated with positive outcomes (Stichter 
et ah, 20 1 0). It is also important for teacher perceptions to be 
compared with direct observation of salient features of 
SW-PBIS. For instance, a teacher may have the skills and 
knowledge necessary to implement effective practices, but 
experiences of emotional exhaustion or lack of efficacy may 
interfere with the teacher’s ability to do so; whereas, another 
teacher may exhibit low levels of effective practices primar- 
ily due to a lack of skills. The approach to supporting these 
teachers may look different based on the underlying chal- 
lenge to implementation. Furthermore, past research has 
underscored the need for direct observation of teacher 
behavior in addition to teacher self-reports, as teachers often 
report higher fidelity of implementation related to using spe- 
cific practices than is found through direct observation (e.g., 
Noell et ah, 2005). Because classrooms within schools using 
SW-PBIS should be designed to support and extend the 
school-wide system, the salient features of SW-PBIS can be 
identified and explored at the classroom level (M. Stormont, 
Lewis, Beckner, & Johnson, 2008). These include having 
clear and positively stated classroom rules and expectations, 
using effective instructional management, effectively rein- 
forcing appropriate behavior, and effectively responding to 
behavioral violations (see Simonsen, Fairbanks, Briesch, 
Myers, & Sugai, 2008, for a review). The following section 
provides a description of these classroom-level strategies 
and the research to support their use. 

Effective Classroom Management 

Clear and Positively Stated 
Classroom Rules and Expectations 

One of the fundamental classroom management practices is 
to first develop a set of classroom rules and expectations. 
These rales need to be developmentally appropriate, stated 
positively, and systematically taught. Within the context of 
SW-PBIS, classrooms develop rules that are aligned with 
the school-wide expectations (e.g., Be Kind, Be Safe, Be 
Responsible). This common language supports generaliza- 
tion across school settings. Most classrooms can function 
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well with three to five rules. Effective rules are (a) age appro- 
priate (in terms of language and expectations); (b) specific 
and observable; (c) stated positively, indicating what stu- 
dents should be doing rather than what they should not be 
doing (e.g., keep hands, feet, and objects to yourself; listen 
when others are talking); (d) easy to understand; and 
(e) enforceable (Burden, 2006; Grossman, 2004; Scheuermann 
& Hall, 2008; Sprick, 2006). Research has supported the 
need for positively stated rules that are then taught system- 
atically (Simonsen et al., 2008). 

Effective Instruction 

It is also important for teachers to use the time they have 
with students by maximizing instruction. Not surprisingly, 
teachers who spend more time teaching have students who 
learn more. By definition, students who are engaged in 
instruction (e.g., listening to the teacher, writing, answer- 
ing a question) are not displaying disruptive or off-task 
behaviors (e.g., getting out of seat, talking when inappro- 
priate). When students are engaged in academic instruc- 
tion, they have higher levels of achievement (Greenwood, 
Terry, & Walker, 1994). Therefore, finding ways to 
improve engagement in instruction can prevent problem 
behaviors in the classroom and increase academic achieve- 
ment. Research indicates that instruction that is rigorous, 
relevant, and delivered at a pace appropriate to the content 
is likely to keep students engaged in learning and decrease 
disruptive behavior (see Simonsen et al., 2008). One way 
to increase engagement is to provide students with oppor- 
tunities to respond to academic questions at a pace that 
maximizes learning and engagement. For instance, 
increasing the rate at which students were asked to aca- 
demically respond resulted in improved academic perfor- 
mance in reading (Camine, 1976; Skinner, Smith, & 
McLean, 1994) and math (Skinner, Belfiore, Mace, 
Williams-Wilson, & Johns, 1997). In addition, positive 
effects have been noted for academic engagement and 
decreased disruptive behavior (Carnine, 1976; Sutherland, 
Alder, & Gunter, 2003). An opportunity to respond (OTR) 
is a teacher behavior that solicits a student response. The 
Council for Exceptional Children (CEC, 1987) has pro- 
vided guidelines for the optimal student response rate. 
These guidelines state that four to six responses (mini- 
mum of 3.1) should be elicited from students per minute 
of instruction on new material (CEC, 1987; Gunter, 
Hummel, & Conroy, 1998). 

Reinforce Student Appropriate Behavior 

Research has documented that teachers who interact more 
positively with students have students who do better aca- 
demically and socially. Teachers who deliver a high 
amount of praise typically experience lower off-task or 


disruptive behaviors from their students (Espin & Yell, 
1994). Praise has shown to increase appropriate behavior 
of disruptive students (Reinke, Lewis-Palmer, & Martin, 
2007) and academic engagement of students (Hall, Lund, 
& Jackson, 1968). Increasing academic engagement and 
decreasing disruptive behaviors allow more time for 
instruction. In addition, praise has been shown to increase 
the intrinsic motivation of students and help the learner 
feel more competent (Brophy, 1983; Cameron & Pierce, 
1994). 

Accordingly, researchers have recommended setting a 
standard of interacting with students at a ratio of 4 positive 
interactions to 1 negative interaction (Kalis, Vannest, & 
Parker, 2007). Even the most challenging students engage 
in more positive, compliant behavior, on average, than neg- 
ative behavior. Thus, teachers should attend to students 
when they are engaging in appropriate behavior and specifi- 
cally acknowledge their behavior (M. Stormont & Reinke, 
2009). In particular, the use of specific praise or praise that 
includes a description of the behavior being praised 
(e.g., “Great job working on your math sheet”) is effective 
in decreasing disruptive behaviors in the classroom (Good 
& Brophy, 2003). However, research has found that teach- 
ers do not use behavior-specific praise at high rates (Brophy, 
1983; Reinke, Lewis-Palmer, & Merrell, 2008). Low rates 
of specific praise at the classroom level have also been doc- 
umented within programs that have participated in profes- 
sional in-service trainings on SW-PBIS (M. Stormont, 
Covington, & Lewis, 2006). 

Responding to Behavioral Violations 

Historically, the traditional response to students’ problem 
behavior in schools was to only implement increasingly 
aversive consequences, which was ineffective in reducing 
problem behavior and in many cases exacerbated existing 
problems (Sugai, Sprague, Homer, & Walker, 2000). When 
rule violations occur, it is important to have planned, con- 
sistent, and explicit responses that direct student attention to 
the specific rule they violated and direct professionals to needs 
for environmental changes and/or instruction (M. Stormont 
et al., 2008). When teachers revert to making harsh or 
critical comments, students may actually increase disrup- 
tive behaviors in their classrooms (Van Acker, Grant, & 
Henry, 1996). In contrast, the use of explicit reprimands or 
brief concise remarks that communicate to a student what 
to do instead, following an undesired behavior, decreases 
such behavior (Abramowitz, O’Leary, & Futtersak, 1988; 
McAllister, Stachowiak, Baer, & Conderman, 1969). 
Furthermore, effective classroom managers use a contin- 
uum of strategies for responding to inappropriate behavior, 
including planned ignoring and praising students exhibit- 
ing the appropriate behavior (Reinke, Herman, & Sprick, 
2011 ). 
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Purpose 

As previously stated, classrooms within schools utilizing 
SW-PBIS should be designed to support and extend the 
school-wide system; however, there is a dearth of research 
on whether this actually occurs. To this end, the purposes 
of this study were to examine teachers’ use of specific 
classroom-level practices that align with SW-PBIS. In 
addition, we evaluated the relationship between teachers’ 
reported self-efficacy with classroom management and 
emotional exhaustion, and observed classroom manage- 
ment practices and students’ disruptive behavior. We 
expected to find that some SW-PBIS features that are easy 
to generalize to the classroom, such as posting of positively 
stated rules and expectations, would be utilized by a high 
number of teachers, whereas teacher practices, particularly 
having higher rates of praise to reprimands (4:1 ratio), 
would occur less frequently. Furthermore, while exploratory 
in nature, we hypothesized that teachers with a lower ratio 
of positive to negative interactions, higher use of harsh rep- 
rimands, and higher rates of student disruptive behavior 
would report lower self-efficacy and be more likely to score 
high on a measure of emotional exhaustion. We also 
expected that teachers who used higher rates of praise would 
score higher on self-efficacy and would be less likely to 
report feeling emotionally exhausted. However, in accor- 
dance with past research, we expected that teachers would 
use few specific praise statements. 

Method 

Participants and Setting 

Participants were teachers recruited into a large group ran- 
domized trial evaluating the efficacy of the Incredible Years 
Teacher Classroom Management Program (Webster- 
Stratton, 1997). Only data collected prior to the implementa- 
tion of the intervention are presented in this study. 
Participants included 33 elementary teachers (K to third 
grades) from three elementary schools in a large urban mid- 
western school district implementing SW-PBIS with high 
fidelity. Most participants were female (97%) and White 
(73%). Atotal of 27% of participants were African American. 
Participants’ years of teaching experience ranged from 2 to 
29 years, with an average of 12.71 years ( SD = 6.54). 
Educators held a graduate-level degree (39%) or undergradu- 
ate degree (61%). Table 1 provides school demographic 
information, systematic evaluation tool (SET) scores broken 
down by domain, and the overall SET score for the three 
participating schools. The SET measures implementation of 
SW-PBIS at the school level. A score of 80% or higher for 
the overall score as well as 80% on the expectations taught 
subcategory indicates schools are implementing SW-PBIS 
with high fidelity (see Horner et al., 2004). SET data were 


Table I. Participating School Demographics and SW-PBIS 
Fidelity Indicators From the SET 


Demographic/SET scores 

School 1 

School 2 

School 3 

2010-201 1 enrollment 

358 

363 

407 

Free or reduced lunch (%) 

68 

43 

63 

Student racial composition (%) 

African American 

98 

37 

97 

White 

2 

60 

3 

Other 

0 

3 

0 

SET scores (%) 

Behavioral expectations 

100 

100 

100 

defined 

Behavioral expectations taught 

100 

100 

100 

Behavioral expectations 

100 

100 

100 

rewarded 

Response to rule violations 

75 

63 

50 

Data to monitor student 

100 

100 

100 

behavior 

Management support 

81 

67 

88 

District-level support 

100 

100 

100 

Overall score 

94 

90 

91 


Note. SW-PBIS = School-Wide Positive Behavioral Interventions and Sup- 
ports; SET = systematic evaluation tool. 


collected by evaluators independent of the school district in 
the spring of 2010. These evaluators are individuals 
employed by an outside agency that provides training and 
support to regional school districts in PBIS. These evalua- 
tors received training in administration of the SET by one 
of the authors of the SET. 

Measures 

Direct observation of student and teacher behavior. Indepen- 
dent observers conducted direct observations of student dis- 
ruptive behavior as well as teachers’ use of general praise, 
specific praise, explicit reprimands, harsh reprimands, and 
opportunities to respond using Multi-Option Observation 
System for Experimental Studies (MOOSES; Tapp, 2004). 
MOOSES is a computer-based observation system designed 
for use by independent observers using hand computers to 
record student-student and student-teacher interaction in 
the classroom. Prior to data collection, six observers were 
trained for 4 weeks using videos and practice sessions. Reli- 
ability checks were conducted on 30% of observations, and 
observers received continuing supervision to ensure against 
observer drift. The overall mean percentage agreement 
across raters was 82%, ranging from 50% to 100%. 
MOOSES utilizes second-by-second comparison of raters 
to detennine reliability, and an overall reliability of 80% is 
considered acceptable (Tapp, 2004). The observers not only 
kept a frequency count of student and teacher behaviors 
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across all students in the classroom but also simultaneously 
collected data on teacher behaviors directed to a target stu- 
dent. Every 5 min, a different target student was observed in 
the classroom. All the 5-min observations within the class- 
room were aggregated, producing an overall total of teacher 
and student behaviors for that classroom. Therefore, if a 
classroom had fewer students, the duration of the aggregate 
classroom observation would be lower. However, all vari- 
ables were converted to a common metric by dividing the 
number of behaviors observed by the total minutes observed, 
producing the rate of each behavior occurring in the class- 
room, allowing for comparison across classrooms. Class- 
room observations were each completed in a single day 
early in the school year (October) during either reading or 
math instruction. The length of direct observation per class- 
room ranged from 20 min to 80 min with a mean of 47 min 
across classrooms. The student and teacher behaviors were 
operationally defined as follows: Student disruptive behav- 
ior was defined as any behavior that interrupts instruction; 
general praise was defined as any verbal statement or ges- 
ture that indicates approval and does not name a specific 
behavior; specific praise was defined as any verbal state- 
ment or gesture that indicates approval and names a specific 
behavior; explicit reprimands were defined as verbal com- 
ments or gestures by the teacher that indicate disapproval of 
behavior, but were concise (brief) and issued in a normal 
speaking tone; and harsh reprimands were defined as verbal 
comments or gestures indicating disapproval of a behavior 
that is prolonged, uses excessive force, or uses a voice 
louder than typical for the setting or a harsh, critical, or sar- 
castic tone (e.g., teacher grabbing a student by the arm, rep- 
rimand that stops instruction and lasts for 30 s or more). 
Opportunities to respond were defined as an instructional 
prompt (statement, gesture, or visual cue) that requires an 
immediate academic response to the teacher. See Table 2 for 
operational definitions, examples, and nonexamples of tar- 
geted behaviors. 

Classroom Ecology Checklist. Immediately following obser- 
vations in the classroom, the independent observers completed 
a Classroom Ecology Checklist (Reinke & Lewis-Palmer, 
2005). The Classroom Ecology Checklist is a 20-item ques- 
tionnaire that assesses the classroom on the following 
dimensions: (a) classroom structure, (b) behavioral 
expectations, (c) instructional management, (d) interact- 
ing positively, (e) responding to appropriate behavior, and 
(f) responding to inappropriate behavior. Cronbach’s alpha 
for the measure is .86. For the purpose of this study, we used 
specific items that were directly linked with effective rules 
and expectations, effective instructional practices, reinforc- 
ing appropriate behavior, and effective practices for dis- 
couraging inappropriate behavior that align with the salient 
SW-PBIS strategies identified for this study. These items 
include (a) rules and expectations were positively stated 
and visible in the classroom, (b) classroom expectations 


were clear when observing the class, (c) teacher gained stu- 
dents’ attention prior to instruction, (d) more than 70% of 
time was devoted to instruction, (e) teacher provided group 
and individual opportunities to respond, (f) a system for 
documenting appropriate behavior was used, (g) teacher 
used a continuum of consequences for responding to inap- 
propriate behavior, and (h) a system for documenting inap- 
propriate behavior was used. Raters provided a global rating 
of each item on the checklist following completion of no 
less than 20 min of direct observation during instructional 
time. Raters used tangible indicators (e.g., rules posted, 
schedule posted) as well as overall impression (e.g., stu- 
dents followed rules, majority of observation teacher pro- 
vided instruction) when scoring each item. 

Teaching efficacy. The Teacher Sense of Self-Efficacy Scale 
(Tschannen-Moran & Woolfolk Hoy, 2001) is a 24-item 
adaptation of Gibson and Dembo’s teacher efficacy scale. 
Factor analysis revealed three 8-item subscales reflecting (a) 
efficacy for instructional strategies, (b) efficacy for class- 
room behavior management, and (c) efficacy for student 
engagement. The 8-item efficacy for classroom management 
subscale was administered to teachers. Cronbach’s alpha for 
the subscale is .92. The measure was completed by all partici- 
pating teachers in October of the school year. 

Emotional exhaustion. The teacher version of the Maslach 
Burnout Inventory (MB1; Maslach, Jackson, & Leiter, 
1997) is a 22-item measure assessing how frequently teach- 
ers experience feelings of burnout. Each item (e.g., “Working 
with students all day really is a strain for me”) is measured on 
a 7-point scale ranging from 1 = never to 7 = every day. The 
MBI also contains three subscales of burnout: Emotional 
Exhaustion (9 items). Depersonalization (5 items), and Per- 
sonal Accomplishment (8 items). These subscales can be 
analyzed separately or as a whole. The alpha for the total 
burnout measure is .87. For the purposes of this study, emo- 
tional exhaustion was the only subscale used. Example items 
include “1 feel emotionally drained from my work” and “I 
feel I am working too hard on my job.” The alpha for the 
Emotional Exhaustion subscale is .90. The measure was 
completed by all participating teachers in October. 

Procedures 

Teachers from three elementary schools teaching in kinder- 
garten, first, second, and third grade were eligible for par- 
ticipation in the study. The authors met with eligible 
teachers to explain the study and outline data collection 
procedures. Interested teachers then provided informed con- 
sent to participate in the study (100% eligible consented). 
Next, parent consent forms were sent home to all students in 
the participating teachers’ classrooms. Parents returned 
forms indicating whether they gave permission for their 
child to be observed. A total of 83% of parents provided 
informed consent. Students for whom consent was not 
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Table 2. Operational Definitions of Direct Observation Variables 


Teacher frequency code 


CodeT if directed to target student, code O if directed 
to anyone other than target student or by a group of students 


Verbal statement or gesture that indicates approval and names a specific behavior. 

Example:" Thank you for raising your hand,” “Everyone has their eyes on me. Good.” 

Nonexample: “Nice work,” “Good,” “Eyes on me, please.” 

Verbal statement or gesture that indicates approval and does not name a specific behavior. 

Example: Thumbs up, high five, pat on the back, points, tokens, stickers; “Kennedy, thank you,” “Super job,” 
“Good work!” 

Nonexample: “Kennedy, thank you putting your things away quietly," “Super, you guys finished your work.” 
Verbal comments or gestures by teacher to indicate disapproval of behavior; reprimand is concise (brief) 
in a normal speaking tone. 

Example: “China, please have a seat” (when China gets out of her seat), “I am talking, eyes on me” (when 
group of students are talking), use of proximity, finger to lips when students are talking. 

Nonexample: "Heads down on your desk when you are done.” Teacher rolls eyes at students or uses a 
deep exhaustive sigh before or after a reprimand. “No, the answer is 12.” 

Verbal comments or gestures indicate disapproval of behavior using a voice louder than typical for 
setting or harsh, critical, or sarcastic tone. 

Examf>/e:Teacher grabs student, using excessive physical control. Teacher says sarcastically, “What a 
surprise, you haven’t finished your work” or “Shut-up.” 

Nonexample: Teacher writes point on board toward loss of recess without stopping instruction. “Eyes on 
me, please.” 

Opportunity to respond Instructional prompt (statement, gesture or visual cue) that requires immediate academic response to 
oppResp teacher. 

Example:" Who can tell me what 4 x 4 equals?” “Raise your hand if you hear the letter ‘a’ in cot,” “Roland, 
read the next question.” 

Nonexample: “Please put your notebooks away,” “How many people got all of the problems correct?” 
“Keegan, do you need help?” "Eyes on me.” 

Student frequency codes CodeT if behavior is demonstrated by target student, O if behavior is demonstrated by student other 

than the target student or group of students 

Disruptive Any statement or action by an individual student or group of students that interferes with ongoing 

disrp-T classroom activities for the teacher and/or one or more peers. 

disrp-O Examples: Out of seat without permission talking to peer, ripping or crumbling paper in a loud way, 

making covert noises, student calls out answers when expectation is to raise hand. 

Nonexamples: Student accidentally drops a book or other object, making a loud noise; appropriate 
coughing or sneezing noises. 


Specific praise 
Spef-T 
Spef-O 

General praise 
Gen-T 
Gen-O 

Explicit reprimand 
exRep-T 
exRep-O 


Harsh reprimand 
haRep-T 
haRep-O 


received were not included as target students during class- 
room observations. Data collection occurred across the first 
3 weeks of October with observations and teacher comple- 
tion of self-report measures occurring simultaneously. 
Teachers received a small stipend for their time in complet- 
ing the measures. 

Analytic Plan 

First, rates of observed behaviors and the ratio of positive 
to negative interactions were analyzed descriptively for the 
full sample. This information provided the range in use of 
behaviors among all teachers. Next, the mean rates and 
ranges of observed teacher and student behaviors in the 
classroom were reported by the school. In addition, the 
mean percentages on items from the Classroom Ecology 
Checklist that are well aligned with SW-PBIS for each 


school were determined. This information allowed for 
some comparison, although not a direct comparison, with 
SET scores for each school. Finally, linear regression 
analyses with direct observation variables as dependent 
variables and teacher self-efficacy and emotional exhaus- 
tion as predictor variables were conducted. 

Results 

Overall, teachers’ ratios of positive to negative interactions 
were less than optimal. Ideally, teachers will provide four 
positive interactions to every one negative interaction with 
students. In this sample, the mean rates indicated that teach- 
ers provided more reprimands than praise to students. Only 
one teacher in the sample met the criteria of four positives 
to one negative. This teacher actually had a 4.76:1 ratio. 
Two other teachers in the sample had higher rates of 
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Table 3. Mean Rates and Range of Observed Teacher and Student Behavior in the Classroom 


Variable 

Overall sample 

School 1 
(SET = 94%) 

School 2 
(SET = 90%) 

School 3 
(SET = 91%) 

Total praise 

0.56 (0.02-1.74) 

0.53 (0.20-1.22) 

0.54 (0.23-0.93) 

0.60 (0.02-1.74) 

General praise 

0.43 (0.02-1.29) 

0.38 (0.016-0.76) 

0.42 (0.20-0.73) 

0.47 (0.02-1.29) 

Specific praise 

0. 1 3 (0.00-0.47) 

0.14 (0.03-0.47) 

0.13 (0.03-0.23) 

0. 1 3 (0.00-0.46) 

Total reprimands 

0.67 (0.20-1.34) 

1.04 (0.69-1.34) 

0.67 (0.32-1.05) 

0.43 (0.20-0.69) 

Reprimand 

0.65 (0.20-1.30) 

1.01 (0.67-1.30) 

0.64 (0.28-1.00) 

0.41 (0.20-0.58) 

Harsh reprimand 

0.02 (0.00-0.1 1) 

0.03 (0.00-0.09) 

0.03 (0.00-0.09) 

0.01 (0.00-0.1 1) 

Opportunities to respond 

1.48 (0.00-7.03) 

1.41 (0.00-5.80) 

1 .28 (0.03-3.25) 

1 .68 (0.00-7.03) 

Student disruptions 

0.72 (0.23-1.40) 

1.07 (0.71-1.40) 

0.69 (0.30-1.05) 

0.50 (0.23-0.76) 


Note. SET = systematic evaluation tool. 


Table 4. Percentage of Classrooms Observed to Use Effective Behavioral and Instructional Practices 



School 1 

School 2 

School 3 

CEC item 

(SET = 94%) 

(SET = 90%) 

(SET = 91%) 

Classroom routines and expectations are clearly defined, stated in the positive, and visible. 

100 

73 

100 

It is easy to figure out the classroom expectations when observing the class. 

89 

100 

92 

The teacher gains the attention of all students at the beginning of a lesson or transition. 

89 

100 

100 

Based on review of the classroom schedule and observation, it appears that 70% or more 

89 

91 

69 

of class time is allocated to academic instruction. 




The teacher solicits group and individual responses to questions with an effort to provide 

89 

100 

92 

the majority of students with individual opportunities to respond. 

There is a system for documenting and rewarding appropriate student behavior. 

22 

18 

31 

There is a documentation system for managing specific behavioral violations. 

33 

9 

39 

The teacher uses a continuum of consequences to discourage rule violations. 

89 

73 

77 


Note. CEC = Classroom Ecology Checklist; SET = systematic evaluation tool. 


positive to negative, with both having a 2: 1 ratio. The over- 
all range for the sample with regard to positive to negative 
ratio was 4.76:1 to 1:10. In reviewing the data from the full 
sample, teachers were more likely to provide general praise 
than specific praise. Only two teachers in the sample used 
specific praise more than general praise in the classroom. 
The use of harsh reprimands was very minimal across all 
schools. The rate of opportunities to respond was generally 
less than optimal. Research suggests that teachers provide at 
least three to five opportunities during teacher-led instruction 
(CEC, 1987). However, the rates varied. Kindergarten teach- 
ers were more likely to be observed providing three or more 
opportunities per minute, with four out of eight kindergarten 
teachers meeting this criterion. One second grade teacher 
also met this criterion, but most teachers provided one or 
fewer opportunities per minute. The mean rates of praise, 
reprimands, opportunities to respond, and student disruptions 
for the full sample and by school are provided in Table 3. 

Observers completed the Classroom Ecology Checklist 
following classroom observations. The percentage of 


classrooms within each school using the strategies is provided 
in Table 4. Classrooms typically had posted positively stated 
rules and expectations. School 2 had three classrooms in 
which this was not the case. However, observers indicated that 
classroom expectations were clear to someone coming into 
the classroom. Furthermore, two of the schools were rated as 
having considerable time devoted to instruction. Across the 
three schools, observers indicated that documentation systems 
for rewarding student behavior and for recording inappropri- 
ate behavior were not widely utilized. 

In addition to reviewing the observed classroom practices 
of the teachers in the sample, we evaluated the relations 
between teacher practices with teacher’s’ reports of efficacy 
in classroom management and emotional exhaustion. Table 5 
provides a summary of the findings for teachers’ use of gen- 
eral praise, specific praise, explicit reprimands, harsh repri- 
mands, and positive to negative ratio with both outcomes. 
Results indicated a positive relation between teachers’ use of 
general praise and self-efficacy with classroom manage- 
ment. Rate of student disruptions was negatively related to 
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Table 5. Results of Observed Variables Predicting Teacher- 
Reported Efficacy and Emotional Exhaustion 


Observed variable 

Teacher efficacy, 
P(SE) 

Emotional 
exhaustion, p (S£) 

Positive to negative ratio 

.22 (0.34) 

-.34* (0.25) 

General praise 

.38* (0.05) 

-.25 (0.04) 

Specific praise 

.02 (0.02) 

.19 (0.02) 

Explicit reprimand 

-.32 (0.06) 

.29 (0.05) 

Harsh reprimand 

-.32 (0.01) 

.36* (0.01) 

Student disruptions 

-.34* (0.06) 

.36* (0.05) 


*f> < .05. 


self-efficacy. Teachers’ reports of emotional exhaustion 
were positively related to harsh reprimands and student dis- 
ruptions. Emotional exhaustion was negatively related to 
the positive to negative ratio. Specifically, teachers with 
lower rates of positive than negative interactions with stu- 
dents reported feelings of emotional exhaustion. The rela- 
tion between praise and emotional exhaustion was not 
statistically significant. 

Discussion 

The purpose of this study was to examine teachers’ use of 
specific classroom-level practices that align with 
SW-PBIS and the association between these practices and 
teacher-reported self-efficacy in classroom management and 
emotional exhaustion. As expected, results indicated that 
some SW-PBIS features in the classroom were used by a 
high number of teachers. However, this study adds to the 
research in this area by documenting some potential discon- 
nects between high implementation of SW-PBIS at the 
school level, according to the SET, and implementation of 
PBIS strategies in the classroom. These findings indicate 
that some dimensions of SW-PBIS may be more easily 
incorporated into the classroom without further training than 
others. In addition, teacher reports of efficacy and emotional 
exhaustion were related to behaviors observed in the class- 
room. This gives credence to teacher perceptions and their 
impact on classroom behaviors. The main findings and 
implications are discussed. 

Observed Classroom Management Practices 

Teacher use of specific praise was low, and higher rates of 
praise to reprimands (4:1 ratio) were less likely to be 
observed. In fact, only 1 out of 33 teachers was observed to 
have an optimal positive to negative ratio. When praise was 
observed in the classroom, it was much more likely to be 
general praise than specific praise. Specific praise is a higher 
quality of praise because it communicates teacher expecta- 
tions to students while also promoting successful student 


behaviors (Brophy, 1983). This simple effective classroom 
management strategy could be easily incorporated into the 
daily practice of teachers if the appropriate supports are in 
place (Reinke et al., 2007; Reinke et al., 2008). For exam- 
ple, school-based PBIS coaches or consultants could work 
with teachers in planning how and when to use specific 
praise (M. Stormont & Reinke, 2009). Teachers could use 
visual reminders to increase their use of praise, set a goal of 
4: 1 positive to negative interactions, and audio record them- 
selves or have a coach come in to determine whether they 
are meeting the goal, or work to “double-up” on praise by 
providing multiple praise statements to students exhibiting a 
behavior the teacher would like to increase. Research has 
found that when teachers increase their use of praise, their 
use of reprimands decreases (e.g., Reinke et al., 2007; M. A. 
Stormont, Smith, & Lewis, 2007). 

In addition, this study found that the rate of opportunities 
to respond varied and trended toward less than optimal rates. 
Developing strategies to support teachers in increasing their 
rate of opportunities to respond, such as breaking down aca- 
demic problems into smaller steps and using flash cards, can 
support increases in student’s engagement (Sutherland et al., 
2003). Furthermore, each OTR also provides an opportunity 
for praise (Sutherland, Wehby, & Yoder, 2002). It is impor- 
tant that the use of simple strategies should be tried before the 
use of more intrusive strategies. Research has found that, 
even among children with high externalizing behaviors, 
teacher use of praise and precorrective statements was 
related to decreases in problem behavior (Smith, Lewis, & 
Stormont, 2010). Teachers may need data-based perfor- 
mance feedback on their use of these simple strategies to 
effectively and consistently increase them in the classroom 
(Reinke et al., 2008). When trying to increase the use of a 
strategy implemented with low rates, the need for feedback 
appears to be critical for sustaining the practice (Noell et al., 
2005). Successful implementation of a new strategy, partic- 
ularly if positive student behaviors are linked to this new 
practice, will increase the likelihood that teachers will use 
this strategy in the future (Han & Weiss, 2005). 

This study found evidence that some effective classroom 
management variables were indeed in place at the classroom 
level. All three schools had high SET scores and moderately 
high Classroom Ecology Checklist scores on the following 
items: Rules and expectations were positively stated and vis- 
ible, classroom expectations were clear, teacher gained 
attention of the students prior to instruction, more than 70% 
of time was devoted to instruction, teacher provided group 
and individual opportunities to respond, and teacher used a 
continuum of consequences for responding to inappropriate 
behavior. Although the schools scored above 80% on some 
of these items, some had scores in the 60% to 70% range, 
which indicates need for improvement. Having a system for 
reviewing whether these effective classroom management 
strategies are in place from which teachers receive feedback 
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and support toward implementing the practice could result in 
better student outcomes. For instance, the school administra- 
tor or PB1S coach could conduct a walkthrough of class- 
rooms, using a measure similar to the Classroom Ecology 
Checklist to identify what practices are in place and those in 
which the teacher needs additional supports or coaching to 
implement. Use of these effective strategies will support pos- 
itive student outcomes. When teachers provide clear expecta- 
tions, students have fewer disruptive behaviors, allowing for 
more time spent in academic instruction (Grossman, 2004; 
Witt, VanDerHeyden, & Gilbertson, 2004). 

The specific areas of need identified with the Classroom 
Ecology Checklist for schools with high overall scores on 
the SET include establishing systems for documenting and 
rewarding appropriate student behavior and having a docu- 
mentation system for managing specific behavior violations. 
Within the context of tiered prevention models such as 
SW-PBIS and response to intervention, there is increased 
need for teachers to be skilled in the use of universal behavior 
and academic supports, and data collection to monitor stu- 
dent’s progress. A recent study found that some teachers may 
need more support for establishing these systems and under- 
standing how these systems provide data on effectiveness of 
strategies to support appropriate behavior and deter inappro- 
priate behavior (M. Stormont, Reinke, & Herman, 2011). 
Behavior consultants, PBIS coaches, and school psycholo- 
gists need to be prepared to support teachers in developing 
new skills and understanding the need for documentation 
systems. 

Observed Practices, and 

Teacher Efficacy and Emotional Exhaustion 

Main findings from this study related to teacher efficacy 
indicated that teachers with higher rates of general praise 
rated themselves as more efficacious with regard to class- 
room behavior management, whereas rates of general 
praise were negatively related to emotional exhaustion, 
although not statistically significant. Teachers’ use of rep- 
rimands (explicit or harsh) was not predictive of low 
teacher self-efficacy. However, teachers using higher rates 
of harsh reprimands reported feeling higher levels of emo- 
tional exhaustion. Last, teachers in classrooms with higher 
rates of disruptions reported feeling less efficacious and 
had higher levels of emotional exhaustion. 

These findings have important implications for support- 
ing teachers in increasing their use of effective classroom 
management practices. Teaching is an incredibly challeng- 
ing profession, and the need for qualified, effective teachers 
is imperative to student success. However, many teachers 
are not adequately prepared to manage behavior problems in 
the classroom; some even enter the workforce without hav- 
ing taken a single course on behavior management (Barrett 
& Davis, 1993; Evertson & Weinstein, 2006). In fact, half 


of new teachers leave the profession within 5 years, many 
due to the difficulty of working with challenging student 
behaviors (Ingersoll, 2002). As a result, the cost of losing 
teachers significantly impacts students. Monies that could 
be directed to student programs must instead go toward 
the recruitment of new teachers. It has been estimated that 
the cost of teacher turnover in public schools is more than 
7 billion dollars a year (National Commission on Teaching 
and America’s Future, 2007). Teachers who leave the field 
report feeling isolated and having few supports. Therefore, 
providing teachers with the supports and tools they need 
for effective classroom management may reduce teacher 
turnover. Furthermore, providing teachers with access to a 
coach who can support implementation of new and effec- 
tive classroom practices could lead to increased skills and 
confidence in the use of new practices. This in turn can 
lead to increased efficacy among teachers (Han & Weiss, 
2005) and likely reductions in feelings of emotional 
exhaustion. 

Limitations 

Although the findings of this study have important implica- 
tions for supporting the transfer of effective classroom 
management practices into real-world classrooms, there are 
a few limitations that must be considered. First, the sample 
for the study includes 33 elementary teachers from the 
same school district, limiting the generalizability of the 
findings. It is possible that, if a larger sample was used 
across different school districts or with schools from a dif- 
ferent context (i.e., rural school), the findings may have 
been different. In addition, the direct observation data are 
taken from 1 day in the classroom. Data across a number of 
days are recommended to ensure that the data do not repre- 
sent one particularly good or challenging day. Therefore, 
this study is providing only a glimpse into classrooms. In 
addition, reliability of an observation variable was occa- 
sionally lower than optimal; typically for low-occurring 
behaviors when one observer missed or coded the variable 
outside the allotted time period. Second, the study was 
limited to three schools implementing SW-PBIS with high 
fidelity according to the SET, according to the regional 
PBIS support agency. A sample of schools not implement- 
ing SW-PBIS was not accessed. Therefore, it would be 
interesting to compare the level of effective classroom 
management practices in place across schools that are 
implementing and are not implementing SW-PBIS. 
However, this study has value in identifying potential areas 
that SW-PBIS teams could target for support to general 
education classroom teachers. Last, the findings from this 
study are cross-sectional in nature. Thus, we can only con- 
clude that observed practices and teacher report of efficacy 
and emotional burnout are associated with one another, but 
causality cannot be determined. 
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Future Directions 

Future research that evaluates the practices of teachers across a 
larger sample in schools implementing SW-PB1S and a sample 
not implementing a school-wide discipline system could serve 
to better determine how SW-PBIS impacts the practices of 
teachers in their classrooms. Although it appears that SW-PBIS 
training and implementation have increased teachers’ use of 
effective practices, this is difficult to evaluate without a com- 
parison group. Additional research could also assess the 
impact of coaching toward increasing teacher implementation 
of effective classroom management practices. Furthermore, 
research that focuses on identifying teachers in need of addi- 
tional supports, the use of a brief screening measure, or 
walkthrough assessments would greatly add to the literature. 

Summary 

Overall, given the need to support teacher retention in the 
field and protect children from negative teacher-student 
interactions, data from this study underscore the importance 
of assessing behavior and instructional management prac- 
tices at the classroom level. Traditional professional devel- 
opment methods are not effective in changing teachers’ 
classroom practices (see Fixen, Naoom, Blase, Friedman, & 
Wallace, 2005), and teachers may need varying levels and 
different types of supports. Finding ways to identify teach- 
ing practices that are less likely to generalize from SW-PBIS 
trainings and in addition to providing additional training 
with ongoing systematic on-site supports to teachers could 
positively impact large numbers of students through an 
increase in effective teacher classroom management. 
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